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Prediction of academic success in introductory _ 


psychology courses is useful for both students and teachers. Although 
scores‘on the major intellectually oriented standardized aptitude 
tests are often.useful predictors of introductory psychology grades, 
these scores are frgquently: unavailable. When major standardized 
measures of general intellectual aptitude cannot be used, it has been 
' found that the Nelson Denny Reading Test (NDRT) predicts semester 
grades equally well. Still, in order to enhance the predictability of 
success in these courses, an intellectually oriented instrument, the 
Discourse Comprehension Abilities Test (DCAT) was constructed. Part 1 
of the DCAT, the Language Usage Test (LUT), is a 20-minute paper and 
pencil test consisting of three subtests. Part 2 of the DCAT, 
Listening Comprehension (LC), hints of three taped subtests : 


totalling 25 minutes. The purpo 


of this study is to determine the 


extent of correlation between scores on the DCAT and the criterion 
measure, semester point totals, in introductiry psychology classes 
for which entrance tests were largely unavailable, and to determine 
if the DCAT scores are comparable or superior to NDRT scores as 
predictors of academic performance. Results sesicate that although 
the DCAT and NDRT both appear to be useful predicttrs of classroom 
performance, the DCAT .is SRPATEREAY the stronger predictor. (HOD) 
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‘found that the Nelson Denny Reading Test (NDRT) predicts semester grades 


useful for students and teachers; students gain ne ce as * ; 
to whether they are really prepared for the work expected of chein ‘in. the 
course, and teachers gain insights into the ait ite and preparation of ° 
their students, resulting in more appropriate instructional decisions. . 
Betausie the year and four year state institutions th open-admissfon 

enrollment occasionally experience a high failure rate for introductory. 


. 


bevahotoey students, it is Important to determine factors affecting student 

performance and dy denennlne the best predictors of senesearsavades: The 

Psychology Department of Indi ana-Purdue University, Fort Wayne (IPFW) is 

attempting to compile a battery of assessments to be used as Seulesteey of 

elasscods performance since approximately onesquarteecdt the .1800 intro- _— 

ductory psychology students are fai ting or withdrawing from the esureme, 

Although Scores on the major intellectually-oriented standardized 

aptitude tests such as the SAT or the American: College Testing (ACT) Program 

toate (American College Testing Program, 1973) are often, useful ‘predictors 

of introductory psychology.grades (Zimmerman, Wise, & Smith, 1974), thes 
i ! 


scores are frequently unaval lable. gehen’ major standardized measures of 


general intellectual aptitude cannot be used as predictors, it has been 


“ 


a : : . ‘1 
equally well. The median correlation between the NDRT scores and each of 


the two criterion measures used was 0.56 (Gerow & Murphy, 1979); Zimmerman, 


: § 
Wise, +*& Smith (1974) reported a correlation of 0.56 for the ACT total 


measure. ‘Over seven semesters, degree status,and the College Inventory 


of Academic Adjustment (CIAA) in addition to the NDRT, were found to be si 


’ i 


+ ie y 2 cate 


, 
’ ‘ 


. good predictors of classroom performance (Gerow & Murphy , 1979). However, 


because the NROT, degree “status, ‘and CIAA combined accounted for only about — 


20 to 45 percent of the variance in class -Qrades, the search ‘has continued 
for additional predictor variables that individually or follectively could 


enhance the predictabl lity of success in introductory pSychology courses. 
1- 3 - 
It was: decided to construct: an intel Tectually-oriented Instrument , 


the Discourse Gagrahensian Abilities Test (DCAT) .. The DEAT attempts to 


assess factors affecting student performance not tapped | n general . 


ld 


intellectual aptitude measures, NDRT, or CIAA. It was a eee that ~ 
: i. ; 
. ability to integrate information across sentences and to assign relevance 
. (importance) appropriately in discourse patnaen| processing were. 


+, important agents, Robertsen (1968) found a‘significant relat tonship 


fy 


between uncerstand (ing isatent connectors and abilities in listening, reading, 


, and written tenpuaga? Goodman (1968) and van in Dijk (1979) see processing 
“ F = 
fluency as largely resulting from greater familiarity with the cue systems ’ 


° operating In language. | —s ; = 
f “Part one of the DCAT, the Language Usage Test (LUT), isa twenty* : 
minute paper and padeti test consisting of three subtests. A modified 
| cloze procedure js used in subtest one wth two non-related: units of , - ; Me 
5 ‘ . connected discourse. Each unit contains four blanks to: be filled in with 
é | feshical connectors relating. sinGhanke on both local and global levels. : . 
us | Subtest two consists of twelve separate pairs of related sentences with . 


.' - | } ; Nee, 


oo | bJanks between each pair requiring an appropriate logical] connector 


| relating ideas on a Jocal level only. The fol lowing |tem is taken from 


i] 


subtest ‘two. 


oe e ; 
Students are showing greater interest in baseball as a'school 
* sport. 4 gtudents are showing a greater interest 


oe 


in dramatteés. 


The third subtest, ‘consisting of twenty sentences, assesses recognition of 


relevance signalers: summarizers, concluders, theme, superstructure, and 


support indicators. Students must choose) whether ‘each sentence is intro- 


ductory, concluding, transitional, or none. An example sentence from- 


subtest two would be: | 


Clearly then, the energy crises reaurees the Feeotniended two- 
pronged approach. | 


It was also felt that listening comprehension might be another factor . 


e eer | 
in student fallures or successes since high competence in listening as well 
bs reading is essential for superior academic achievement in introductory 
psychology. Two studies claim to have isolated-separate listening and 


reading language comprehension factors (Caffrey, 1953; Spearritt, 1961). 


‘Ruddel! (1979) found listening comprehension highly predictive for 
x \ 


literacy achievement of subjects in grades 8, 9, and 10. Other possible 


factors for prediction were thélight to be passage length, content, format, 


and register. 

Part two of the DCAT, Listening Comprehension (LC), consists of three 
taped subtests totalling twenty-five minutes. Subtest one is a twelve- 
minute introductory psychology lecture segment on human information 


processing with fifteen questions assessing content and register knowledge. 


Subtest two is an eight minute psychological report of a divorce workshop 
| 


: fo adolescents with thirteen questions assessing content, format, and 


register knowledge. Subtest three is a three-minute gavahetegtesl report 


on an instructor-developed aptitude test as a predictor with ten questions 
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assessing content, Format, and register knowledge. Each passage in part 

two increases in content difficulty, format unfant Liarity;, sad atin 

formality. ’ So : . oS | | Ae 
The. purpose ot this atady was to determine the extent of correlation — 

between scores on the DCAT and the criterion sucegee Crate Point 


B90 Totals in introductory psychology classes for which entrance tests were 


* Jargely unavailable, and to determine Ff the DCAT scores” were. comparable 


or superjor to NDRT- eeeeek as’ predictors of Baydenic performance, , ‘ 
. a e 1 6 é , 
ee 2 F Method 
A The : ‘cad and NDRT were administered-to 64 students enrolled. in an 
—, 


3 


introductory psychology class as early ina summer session as was feasible. 
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; Results , : 
(* 


“The following Fesults are apparent from inspection of the entries of 
@ . r Ps ° 


a 


Table |. | ae 
1. Discourse Comprehension Abilities: Test (DCAT), Language pease Test 
/ (LUT) , and“ chaventn Comprghension (LC) scorés dre capvetabed | 
- rs 72, r= -61,, and 4 = .66 respectively with Semester Pali Tekan 
ee is on the basis of thi’s Semester Point Total that grades in the ¢ 
course ‘are assigned. L 4 
2. The Nelson Denny Reading Test (NORT) and its vocabulary subtest 
(ND VOC) scores were correlated r = .56 and r = .49 with Semester 
Point Total. 
3. The NDRT and LUT scores combined were correlated R = .68 ae Semester 
Point Total. 
. ¢ . ; 
oF 


) 
h, The ND VOC and LUT scores combined were correlated R =~.66 with 


ester Point Total. | ' 


Discussion 
- The DCAT appears to be a.very promising predictor of classroom Per - 


. formance since it accounted for approximately 52 percent of the variance 


| 
| 


, ; : 
in class-grades. With only a Fingle correlation, however, it is apparent 


that more investigation of the DCAT is necessary. If een 


‘persist at the same level of magnitude after further testing, the D¢AT 
could be considered not only a good addition to the battery of predictor 


= tests already discovered, but perhaps even a better predictor for student, 


achievement in introductory psychology than the NORT. 


References 


Aleamoni, L. M. ‘and Oboler, L. ACT versus SAT in predicting first semester 


GPA. - Educational and Psychological Measurement, 1978, 38, 393-399. - 


American College Testing Program. Assessing students on the way to college: 
WH 5 : ‘ ; . ? 


: Technical report for the ACT assessment program. lowa City, lowa:. 


American College Testing Program, 1973. 
Caffrey, ‘J. Auding ability as a function of certain psychometric variables. 
Doctoral dissertation, University of California at Berkeley, 1953. 
van. Dijk, TL. A. ‘Relevante assignment in discourse comprehension. ®iscourse 

| Processes, 1979, 2, 113-126. 
Gere, 2. R. and Murphy, D. P= The validity of the Nelson Denny Reading 


w 
_ Test as a predictor of performance in Introductory Psychology. 


Educational and Psychological Measurement, in press. 
Goodman, K. S. The psycholinguistic nature of the reading process. 
Detroit: Wayne State University Press, 1968, 13-26. 


Robertson, J. L. Pupil understanding of connectives in reading. Reading 


Research Quarterly, 1968, 3, 387-417. 
Ruddel], R. B. Early prediction of reading success: Profiles of good and 
. poor readers. Unpublished manuscript, 1979. 
Spearritt, D. A factorial analysis of listening comprehension. Doctoral 
. dissertation, Harvard University, 1963. 
Zimmerman, R. R., Wise, L., and Smith, 0. W. Early detection of final . 


i performance in an introductory course in general psychology. 


Psychological Reports, 1974, 35, 620-622. 


Table | tia 
Correlations’ between Predictors and’ Semester 


Point Totals for Subjects (N = 64) 


- } “ 
Se ee en eS a Re ge ee ae ee eee ea 
Measures ae - .. Correlation 
Discourse Comprehenston Abilities Test (DCAT) r= .72 
Language Usage Test (LUT) i 6:4 r= .6T) 
Listening Comprehension Zi as - rs 66 
Nelson Denny, Reading Test (NDRT) ' “p= 56: 
Nelson Denny Vocabulary (ND-VOC) ree 49° 
NDRT and. LUT | Pe vay? 2 “ga Fea 568 
ND VOC and LUT’ pe a, OF capac 
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